Information processing device and display control method

ABSTRACT

An information processing device includes a memory and a processor coupled to the memory. The processor is configured to determine whether a first action is performed. The first action is defined as indicating an intention to contact an object displayed at a position that may not be contacted by a thumb approaching a display unit on which a screen image is displayed. The processor is configured to move, when it is determined that the first action is performed, the screen image in a direction in which the object approaches the thumb.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based upon and claims the benefit of priority of theprior Japanese Patent Application No. 2016-041084, filed on Mar. 3,2016, the entire contents of which are incorporated herein by reference.

FIELD

The embodiments discussed herein are related to an informationprocessing device and a display control method.

BACKGROUND

When the easiness of a one-hand operation is emphasized, a screen of atouch panel display of a tablet device (e.g., a smart phone) is requiredto have a size enabling the thumb to touch any point on the screen in astate where the tablet device is grasped by one hand. Meanwhile, whenthe easiness of a visual recognition of displayed contents isemphasized, the screen size is required to be large.

A technology exists, in which even when the screen size is large, inorder to facilitate the one-hand operation, a screen image displayed onthe screen is reduced overall, and the reduced screen image is displayedat a position where the operation by the thumb is easily performed.Also, a technology exists, which determines a region where the operationby the thumb may be performed, in order to determine a region where thereduced screen image is to be displayed.

Related techniques are disclosed in, for example, Japanese Laid-OpenPatent Publication No. 2013-030050 and Japanese Laid-Open PatentPublication No. 2014-179877.

However, the technologies require a display change operation such astapping a specific icon, in order to change between displaying and notdisplaying the reduced screen image. When the display change operationis frequently required, the user experience may be deteriorated.Further, the reduction of the screen image may cause an erroneousoperation such as tapping an icon nearby an intended icon.

SUMMARY

According to an aspect of the present invention, provided is aninformation processing device including a memory and a processor coupledto the memory. The processor is configured to determine whether a firstaction is performed. The first action is defined as indicating anintention to contact an object displayed at a position that may not becontacted by a thumb approaching a display unit on which a screen imageis displayed. The processor is configured to move, when it is determinedthat the first action is performed, the screen image in a direction inwhich the object approaches the thumb.

The object and advantages of the disclosure will be realized andattained by means of the elements and combinations particularly pointedout in the claims. It is to be understood that both the foregoinggeneral description and the following detailed description are exemplaryand explanatory and are not restrictive of the disclosure, as claimed.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an exemplary functional configurationof a smart device according to a first embodiment;

FIG. 2 is a diagram illustrating an exemplary hardware configuration ofthe smart device according to the first embodiment;

FIG. 3 is a diagram illustrating a display control process according tothe first embodiment;

FIG. 4 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 5 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 6 is a flowchart illustrating an exemplary flow of the displaycontrol process according to the first embodiment;

FIG. 7 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 8 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 9 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 10 is a diagram illustrating the display control process accordingto the first embodiment;

FIG. 11 is a diagram illustrating an exemplary hardware configuration ofa smart device according to the first embodiment;

FIG. 12 is a diagram illustrating an exemplary functional configurationof a smart device according to second and third embodiments;

FIG. 13 is a diagram illustrating an exemplary hardware configuration ofthe smart device according to the second and third embodiments;

FIG. 14A is a diagram illustrating an example of a pressure sensor;

FIG. 14B is a diagram illustrating an example of a pressure sensor;

FIG. 15 is a diagram illustrating a display control process according tothe second embodiment;

FIG. 16 is a diagram illustrating the display control process accordingto the second embodiment;

FIG. 17 is a diagram illustrating the display control process accordingto the second embodiment;

FIG. 18 is a flowchart illustrating an exemplary flow of the displaycontrol process according to the second embodiment;

FIG. 19 is a diagram illustrating the display control process accordingto the second embodiment;

FIG. 20A is a diagram of an example of a pressure sensor;

FIG. 20B is a diagram of an example of a pressure sensor;

FIG. 21 is a diagram illustrating the display control process accordingto the second embodiment;

FIG. 22 is a diagram illustrating a display control process according tothe third embodiment;

FIG. 23 is a diagram illustrating the display control process accordingto the third embodiment;

FIG. 24 is a flowchart illustrating an exemplary flow of the displaycontrol process according to the third embodiment;

FIG. 25 is a diagram illustrating the display control process accordingto the third embodiment; and

FIG. 26 is a diagram illustrating the display control process accordingto the third embodiment.

DESCRIPTION OF EMBODIMENTS First Embodiment

Hereinafter, a first embodiment will be described with reference to thedrawings.

As illustrated in FIG. 1, a smart device 10 as an example of aninformation processing device includes a determination unit 11, adisplay controller 12, and a display unit 14. The determination unit 11determines whether an action is performed with an intention to contactan object displayed at a position which may not be contacted by thethumb approaching the display unit 14 displaying a screen image thereon.When it is determined by the determination unit 11 that the action withthe intention to contact the object is performed, the display controller12 performs a control to move the screen image in a direction in whichthe object approaches the thumb.

In the present embodiment, the information processing device is notlimited to a smart device. The information processing device may be anydevice which may be grasped by one hand and is provided with a touchpanel display. Examples of the information processing device include amobile phone, a smart phone, a tablet computer, or the like.

As illustrated in FIG. 2, the smart device 10 includes a centralprocessing unit (CPU) 31 as an example of a processor, a primary memory32, a secondary memory 33, a touch panel display 34, and an externalinterface 38. The CPU 31, the primary memory 32, the secondary memory33, the touch panel display 34, and the external interface 38 arecoupled to each other through a bus 39.

The primary memory 32 may be a volatile memory such as a random accessmemory (RAM). The secondary memory 33 may be a non-volatile memory suchas a hard disk drive (HDD) or a solid state drive (SSD).

The secondary memory 33 includes a program storage area 33A storing adisplay control program.

The CPU 31 reads out the display control program from the programstorage area 33A of the secondary memory 33, and loads the program inthe primary memory 32. The CPU 31 executes the display control programso as to act as the determination unit 11 and the display controller 12of FIG. 1. The display control program may be stored in an externalserver and loaded in the primary memory 32 through a network. Thedisplay control program may be stored in a non-transitoryrecording-medium such as a digital versatile disc (DVD) to be read by arecording-medium reading device and loaded in the primary memory 32.

The touch panel display 34 includes a touch panel 34A and a display 34Bas an example of the display unit 14. The touch panel 34A detects atouching (contacting) action and a hovering (approaching) action withrespect to the touch panel 34A. The display 34B displays a screen imagesuch as a user interface screen including an object such as anapplication icon.

An external device is coupled to the external interface 38. The externalinterface 38 transmits and receives various types of information betweenthe external device and the CPU 31.

Subsequently, an operation of the smart device 10 according to thepresent embodiment will be described. In the present embodiment, anaction of stretching a thumb 61A (FIG. 3) is performed as an example ofan action with an intention to contact (which may be referred to “touch”hereinafter) an object displayed on the touch panel display 34. FIG. 3illustrates a front view of the smart device 10 grasped by the righthand 60 of a user. The “front view” refers to a diagram of the smartdevice 10 viewed from the side of the touch panel display 34.

The Mount of Venus on the right hand 60 of the user is kept in a stateof contacting with the right surface 52R of a housing 51 of the smartdevice 10 in the front view. The thumb 61A of the user is kept in astate of not contacting with the touch panel display 34. Further, theforefinger 61B, the middle finger 61C, the ring finger 61D, and thelittle finger 61E of the user contact with the left surface 52L of thehousing 51 in the front view. When the user intends to touch an objectdisplayed on the touch panel display 34, and the object is presentwithin a range that the thumb 61A reaches, the thumb 61A is mostly in aslightly bent state as illustrated in FIG. 3.

Meanwhile, when the user intends to touch an object displayed on thetouch panel display 34, and the object is present beyond the range thatthe thumb 61A reaches, the user naturally stretches the thumb 61A asillustrated in FIG. 4. In this case, the thumb 61A may be stretchedtoward the object, while the user intending to touch the object.

According to the present embodiment, as illustrated in FIG. 5, when thethumb 61A is stretched, the CPU 31 performs a control to move a screenimage 53-0 displayed on the touch panel display 34 in the direction ofan arrow 73 indicating the reverse direction to an arrow 72 indicatingthe stretched direction of the thumb 61A. That is, the direction of thearrow 73 is the direction in which the object approaches the thumb 61A.The screen image 53-0 is a screen image in a normal display state priorto a display change process.

The straight line 71 indicates the orientation of the stretched thumb61A. A movement amount L indicates a movement distance of the screenimage 53-0. A screen image 53-N (N is a natural number) is a screenimage that has been moved N times by the movement amount L. Hereinafter,the screen image may be referred to as a “screen image 53” when screenimages are not discriminated.

A screen image 53-1 is obtained when the screen image 53-0 is moved bythe movement amount L. A screen image 53-2 is obtained when the screenimage 53-1 is moved by the movement amount L. The movement amount L maybe, for example, 1/20 to 1/10 of the diagonal length of the touch paneldisplay 34.

For example, when the power of the smart device 10 is turned ON, thedisplay control process illustrated in FIG. 6 is started. In 201, theCPU 31 determines whether the thumb 61A is hovering over the touch paneldisplay 34, and the hovering thumb 61A is stretched for a predeterminedtime or longer. The predetermined time may be, for example, 2 seconds.The determination in 201 is repeated until the result of thedetermination is “Yes”.

When the thumb 61A is hovering over the touch panel display 34, anelectrostatic capacitance depending on the irregularities of the ventralsurface of the thumb 61A is detected by the touch panel 34A, asillustrated in FIG. 7. Accordingly, the CPU 31 may determine whether thethumb 61A is stretched, by determining whether the area of a region 80exceeds a predetermined area. Here, the region 80 is a region where theelectrostatic capacitance detected by the touch panel 34A exceeds apredetermined value.

The predetermined area may be the area of a region where theelectrostatic capacitance exceeds a predetermined value, when the thumb61A in the stretched state is hovering over the touch panel display 34.The predetermined area may be registered in advance by a user, forexample. Alternatively, the area of the region 80 detected prior to thestretching of the thumb 61A may be registered as an initial value, andthe CPU 31 may determine whether the thumb 61A is stretched bydetermining whether the area of the region 80 increases by apredetermined value or more from the initial value.

When the result of the determination is “Yes” in 201, the CPU 31acquires the direction of the thumb 61A in 202.

The region 80 illustrated in FIG. 7 includes a region 81 between thefirst joint and the tip end of the thumb 61A, and a region 82 betweenthe first joint and the root of the thumb 61A. The regions 81 and 82exhibit higher electrostatic capacitances than that of a region 83included in the region 80 and other than the regions 81 and 82. Thestraight line 71 passing points 84 and 85 in the regions 81 and 82,respectively, where the electrostatic capacitance is the highest,indicates the direction of the thumb 61A.

The straight line 71 intersects the ends of the touch panel display 34at points 87 and 88. The stretched direction of the thumb 61A (which maybe referred to as the “direction of the thumb 61A” hereinafter) is thedirection from a point of the higher electrostatic capacitance sidetoward a point of the lower electrostatic capacitance side, between thepoints 87 and 88. The root of the thumb 61A is present near the point ofthe higher electrostatic capacitance side. In FIG. 7, the direction ofthe thumb 61A is the direction from the point 87 toward the point 88.

As illustrated in FIG. 8, in 203, the CPU 31 moves the screen image 53-0displayed on the touch panel display 34 in the reverse direction to thedirection of the thumb 61A, that is, in the direction indicated by thearrow 73 from the point 88 toward the point 87, by the movement amountL. That is, the CPU 31 performs the display change process. The screenimage 53-1 represents a screen image after the movement.

In 204, the CPU 31 determines whether a screen change operation isdetected. The screen change operation is a user's operation of touchingan object (e.g., an application icon) with an intention to change ascreen in order to, for example, start an application. When the resultof the determination is “Yes” in 204, the CPU 31 ends the displaycontrol process, and performs a process corresponding to the detectedscreen change operation.

When the result of the determination is “No” in 204, the CPU 31determines in 205 whether the thumb 61A is stretched in the samedirection as the direction acquired in 202. When the result of thedetermination is “No” at 205, the CPU 31 causes the screen image 53 tobe moved to the original position to cause the touch panel display 34 todisplay the screen image 53-0, and ends the display control process.When the direction of the thumb 61A is different from the directionacquired in 202, or when the stretched thumb 61A is bent, the result ofthe determination is “No” at 205. That is, when the user stops theaction of stretching the thumb 61A toward a specific object, the CPU 31causes the touch panel display 34 to display the screen image 53-0, andends the display control process.

When the user is no longer interested in the object that the user hasintended to touch, for example, when the user stretches the thumb 61Atoward an object different from an object that the user has intended totouch, the user stops the action of stretching the thumb 61A. Accordingto the present embodiment, the moved screen image 53 is moved back tothe original position when the action of stretching the thumb 61A isstopped, that is, when the stretched thumb 61A is bent.

With the above-described control, the display change process may bestarted by stretching the thumb 61A, and the moved screen image 53 maybe moved back to the original position by bending the stretched thumb61A or changing the direction of the stretched thumb 61A. When thedisplay change process is performed, the action of bending the stretchedthumb 61A or the action of changing the direction of the stretched thumb61A may be accidentally performed without an intention to move thescreen image 53 back to the original position. Thus, the moved screenimage 53 may be caused to be moved back to the original position when itis detected that the state of bending the stretched thumb 61A orchanging the direction of the stretched thumb 61A is kept for apredetermined time.

When the result of the determination is “Yes” in 205, the CPU 31determines in 206 whether the movement of the screen image 53 is ended.For example, it is determined that the movement of the screen image 53is ended when a point 89 of the screen image 53 corresponding to thepoint 88 of FIG. 8 is moved beyond the point 84 corresponding to thehighest position between the first joint and the tip end of the thumb61A.

FIG. 8 illustrates an example where the movement of the screen image 53is ended when the screen image 53-0 is moved five times. In the normaldisplay state, the thumb 61A is stretched toward an object presentbetween the points 84 and 88. Therefore, the object reaches the positionwhere the thumb 61A may touch the object, before the point 89corresponding to the point 88 is moved to the point 84.

When the result of the determination is “No” at 206, that is, when themovement of the screen image 53 is not ended, the CPU 31 returns to 203to move the screen image 53 by the movement amount L. When the result ofthe determination is “Yes” at 206, the CPU 31 returns to 204 to repeatthe processes of 204 to 206 until the result of the determination is“Yes” at 204 or the result of the determination is “No” at 205. That is,the CPU 31 causes the screen image 53 to be displayed as it is, withoutmoving the image, while no screen change operation is performed and thethumb 61A is stretched in the same direction.

In the present embodiment, descriptions have been made on the examplewhere the user grasps the smart device 10 with the right hand. However,the present embodiment may be equally applied to a case where the usergrasps the smart device 10 with the left hand as well. FIG. 9illustrates an example of the electrostatic capacitance detected whenthe thumb is stretched, in the case where the user grasps the smartdevice 10 with the left hand. FIG. 10 illustrates an example of themovement of the screen image 53.

In the present embodiment, descriptions have been made on the examplewhere the touch panel 34A detects the electrostatic capacitancegenerated by the thumb hovering over the touch panel display 34.However, the present embodiment is not limited to the example. Forexample, as illustrated in FIG. 11, the smart device 10 may furtherinclude a proximity sensor 36. The proximity sensor 36 may be any one ofan induction type proximity sensor, an electrostatic capacitance typeproximity sensor, an ultrasonic wave type proximity sensor, anelectromagnetic wave type proximity sensor, and an infrared ray typeproximity sensor. The CPU 31 may detect the thumb hovering over thetouch panel display 34 by using the proximity sensor 36.

According to the present embodiment, the determination unit 11determines whether an action is performed with an intention to contactan object displayed at a position that may not be contacted by the thumbapproaching the display unit 14 displaying a screen image thereon. Whenit is determined by the determination unit 11 that the action with theintention to contact the object is performed, the display controller 12performs a control to move the screen image in the direction in whichthe object approaches the thumb.

According to the present embodiment, the determination unit 11determines whether an action of stretching the thumb approaching thedisplay unit 14 is performed, as the action with an intention to contactthe object. When it is determined that the action of stretching thethumb is performed, the display controller 12 performs a control to movethe screen image in the reverse direction to the stretched direction ofthe thumb.

For example, when a user grasps a smart device 10 with one hand, and theuser intends to touch an object (e.g., an application icon) present at aposition that the thumb does not reach, the user stretches the thumbtoward the object. According to the present embodiment, since the screenimage is moved in the reverse direction to the stretched direction ofthe thumb, the object approaches the thumb.

According to the present embodiment, the determination unit 11 furtherdetermines whether the stretched thumb is bent. When it is determined bythe determination unit 11 that the thumb is bent, the display controller12 causes the moved screen image to be moved back to the originalposition.

That is, according to the present embodiment, the display change to ascreen image which facilitates the one-hand operation on the informationprocessing device may be implemented by the action of stretching thethumb toward an object, that is, a natural action for the user.

Second Embodiment

Subsequently, a second embodiment will be described with reference tothe drawings. Descriptions of similar configurations and operations tothose in the first embodiment will be omitted.

The smart device 10 illustrated in FIG. 12 includes a detector 13, inaddition to the determination unit 11, the display controller 12, andthe display unit 14. The detector 13 detects an operation amount on thesmart device 10. The display controller 12 determines a movement amountof the screen image, based on the operation amount detected by thedetector 13.

As illustrated in FIG. 13, the smart device 10 includes a pressuresensor 37 as an example of the detector. For example, as illustrated inFIG. 14A, a right pressure sensor 37R is provided in the lower portionof the right surface 52R of the smart device 10 in the front view.Further, as illustrated in FIG. 14B, a left pressure sensor 37L isprovided in the lower portion of the left surface 52L of the smartdevice 10 in the front view.

Subsequently, an operation of the smart device 10 according to thepresent embodiment will be described. In the present embodiment, anaction of stretching the thumb 61A is performed as an example of anaction with an intention to contact an object. FIG. 15 illustrates afront view of the smart device 10 grasped by the right hand 60 of theuser. As illustrated in FIG. 15, when the thumb 61A is bent, the userloosely grasps the smart device 10 so that no strong pressure is appliedto a region 91R with which the Mount of Venus on the palm contacts, anda region 91L with which the middle finger 61C, the ring finger 61D, andthe little finger 61E contact.

Meanwhile, as illustrated in FIG. 16, when the user stretches the thumb61A with an intention to touch an object beyond the range that the thumb61A reaches, the user strongly grasps the smart device 10 so that astrong pressure is applied to the regions 91R and 91L. In the presentembodiment, descriptions are made on the example where the middle finger61C, the ring finger 61D, and the little finger 61E contact with theregion 91L. However, the present embodiment is not limited to theexample. All that is required is that at least one of the forefinger61B, the middle finger 61C, the ring finger 61D, and the little finger61E contacts with the region 91L.

According to the present embodiment, as illustrated in FIG. 17, the CPU31 determines, based on the pressure applied to the regions 91R and 91L,a movement amount M for moving the screen image 53-0 that is a screenimage in the normal display state.

For example, when the power of the smart device 10 is turned ON, thedisplay control process illustrated in FIG. 18 is started. In 211, theCPU 31 determines whether a value SP of a pressure applied to the rightpressure sensor 37R and the left pressure sensor 37L is equal to or morethan a predetermined value P for a predetermined time or longer. Thepredetermined time may be, for example, 2 seconds. The determination in211 is repeated until the result of the determination is “Yes”.

The pressure value SP is an average of a value SPR of the pressureapplied to the right pressure sensor 37R and a value SPL of the pressureapplied to the left pressure sensor 37L. In 211, it is determinedwhether the condition of the expression (1) is met.

SP (=(SPR+SPL)/2)>P   (1)

When the result of the determination is “Yes” in 211, the CPU 31determines in 212 whether the thumb 61A is stretched. When the result ofthe determination is “No” in 212, that is, when the thumb 61A is notstretched, the CPU 31 returns to 211. When the result of thedetermination is “Yes” in 212, the CPU 31 acquires the direction of thethumb 61A in 213.

The CPU 31 acquires a movement amount M of the screen image 53-0 in 214.The movement amount M is determined based on the pressure detected bythe right pressure sensor 37R and the left pressure sensor 37L. Themovement amount M of the screen image 53-0 is acquired by applying, forexample, the expression (2) for a model of a spring 92 (FIG. 19) havinga spring constant K.

M=SP/K   (2)

While descriptions have been made on the example where the movementamount M is acquired by applying the expression (2), the presentembodiment is not limited to the example. All that is required is thatthe movement amount M is determined to increase as the value of thepressure increases.

In 215, the CPU 31 causes the screen image 53-0 to be moved, by themovement amount M, in the direction of the arrow 73 indicating thereverse direction to the direction of the arrow 72 indicating thestretched direction of the thumb 61A acquired in 213. Then, the CPU 31causes the touch panel display 34 to display the moved screen image53-1. In 216, the CPU 31 determines whether a screen change operation isdetected. When the result of the determination is “Yes” in 216, the CPU31 ends the display control process, and performs a processcorresponding to the screen change operation.

When the result of the determination is “No” at 216, the CPU 31determines in 217 whether the value SP, which is the average of thevalue SPR of the pressure applied to the right pressure sensor 37R andthe value SPL of the pressure applied to the left pressure sensor 37L,exceeds the predetermined value P. When the result of the determinationis “Yes” in 217, that is, when the condition of the expression (1) ismet, the CPU 31 returns to 216. That is, when the smart device 10 iskept in the state of being strongly grasped by the user, the screenimage 53-1 is not moved and is displayed as it is. Meanwhile, when theresult of the determination is “No” at 217, that is, when the smartdevice 10 is loosely grasped by the user, the CPU 31 causes the screenimage 53-1 to be moved back to the original position to cause the screenimage 53-0 to be displayed, in 218.

In the present embodiment, descriptions have been made on the examplewhere two pressure sensors 37 are provided in the lower portions of thelateral surfaces 52R and 52L of the housing 51 of the smart device 10 inthe front view. However, the present embodiment is not limited to theexample. For example, the pressure sensor 37 may be provided in only oneof the lateral surfaces 52R and 52L of the housing 51 of the smartdevice 10 in the front view.

As illustrated in FIG. 20A, the smart device 10 may include a pressuresensor 37RU in the upper portion of the right lateral surface 52R of thehousing 51 of the smart device 10 in the front view and a pressuresensor 37RD in the lower portion thereof. In addition, as illustrated inFIG. 20B, the smart device 10 may include a pressure sensor 37LU in theupper portion of the left lateral surface 52L of the housing 51 of thesmart device 10 in the front view and a pressure sensor 37LD in thelower portion thereof. When the smart device 10 is grasped with a topsurface 52U facing upward, the pressure may be detected by the pressuresensors 37RD and 37LD provided in the lower portions in that position.In addition, when the smart device 10 is grasped with the bottom surface52D facing upward, the pressure may be detected by the pressure sensors37RU and 37LU provided in the lower portions in that position.

In the present embodiment, descriptions have been made on the examplewhere the movement amount M is determined depending on the pressurevalue. However, the present embodiment is not limited to the example.The movement amount M may be a predetermined value (e.g., a fixedvalue).

In the present embodiment, descriptions have been made on the examplewhere the pressure value is applied as an example of the operationamount. However, the present embodiment is not limited to the example.For example, the length of the hovering time during which the thumb 61Ais stretched and hovering over the touch panel display 34 may be appliedas the operation amount. In this case, the movement amount M of thescreen image 53-0 may be increased in proportion to the length of thehovering time.

In the present embodiment, the process of at least a portion of thefirst embodiment may be applied. For example, in the present embodiment,descriptions have made on the example where the screen image 53-1 ismoved back to the original position when the value SP of the pressureapplied to the smart device 10 does not exceed the predetermined valueP. However, the present embodiment is not limited to the example. Forexample, the screen image 53-1 may be moved back to the originalposition when the thumb 61A is bent or when the direction of the thumb61A is changed, as in the first embodiment.

In the present embodiment, descriptions have been made on the examplewhere the smart device 10 is grasped by the right hand. However, thepresent embodiment is not limited to the example and may be applied tothe case where the smart device 10 is grasped by the left hand. FIG. 21illustrates an example of the movement of the screen image 53-0 when thesmart device 10 is grasped by the left hand.

According to the present embodiment, the determination unit 11determines whether an action is performed with an intention to contactan object displayed at a position that may not be contacted by the thumbapproaching the display unit 14 displaying a screen image thereon. Whenit is determined by the determination unit 11 that the action with theintention to contact the object is performed, the display controller 12performs a control to move the screen image in the direction in whichthe object approaches the thumb.

According to the present embodiment, the determination unit 11determines whether an action of stretching the thumb approaching thedisplay unit 14 is performed, as the action with the invention tocontact the object. When it is determined that the action of stretchingthe thumb is performed, the display controller 12 performs a control tomove the screen image in the reverse direction to the stretcheddirection of the thumb.

According to the present embodiment, the information processing devicefurther includes the detector 13 that detects the operation amount onthe information processing device, and the display controller 12determines the movement amount of the screen image based on theoperation amount detected by the detector 13.

According to the present embodiment, the operation amount is a value ofthe pressure applied to the information processing device when an actionof grasping the information processing device is performed.

For example, when a user grasps a smart device 10 with one hand, and theuser intends to touch an object (e.g., an application icon) present at aposition that the thumb does not reach, the user stretches the thumbtoward the object. At this time, a stronger pressure is applied to thesmart device 10 by the user's fingers grasping the smart device 10, thanthat when the thumb is not stretched. The movement amount M of thescreen image 53-0 is determined depending on a value of the pressure.

According to the present embodiment, the display change to a screenimage which facilitates the one-hand operation on the informationprocessing device may be implemented by the user's natural action ofstretching the thumb toward an object and strongly grasping theinformation processing device.

Third Embodiment

Subsequently, a third embodiment will be described with reference to thedrawings. Descriptions of similar configurations and operations to thosein the first and second embodiments will be omitted. The thirdembodiment is different from the second embodiment in that a touch panel34A according to the third embodiment detects the action of touching thetouch panel 34A, but does not detect the hovering operation.

An operation of the smart device 10 according to the present embodimentwill be described. In the present embodiment, an action of grasping thesmart device 10 so as to cause a strong pressure to be applied to thedevice is detected as the action with the intention to contact anobject. In the present embodiment, as in the second embodiment, the CPU31 determines the movement amount M for moving the screen image 53-0illustrated in FIG. 22, based on the pressure applied to the regions 91Rand 91L illustrated in FIG. 16. Unlike the second embodiment, however,the direction of the thumb 61A is not determined in the presentembodiment.

The orientation of a straight line 93 corresponding to the straight line71 indicating the orientation of the stretched thumb 61A in the firstand second embodiments and the direction of an arrow 94 indicating thereverse direction to the direction of the thumb 61A are registered inadvance as illustrated in FIG. 23. The orientation of the straight line93 corresponding to the orientation of the stretched thumb 61A may beregistered in the manner that the user designates points 95 and 96. Theorientation of the straight line 93 corresponding to the orientation ofthe stretched thumb 61A may be registered in the manner that the userstretches the thumb 61A to cause the thumb 61A to hover over the touchpanel display 34, and the hovering thumb 61A is detected by the touchpanel 34A.

For example, when the power of the smart device 10 is turned ON, thedisplay control process illustrated in FIG. 24 is started. In 215, whenmoving the screen image 53-0, the CPU 31 causes the screen image 53-0 tobe moved in the pre-registered direction of the arrow 94 by the movementamount M. Since 211, 214, 216, 217, and 218 are identical to those inthe second embodiment, descriptions thereof will be omitted.

In the present embodiment, the process of at least a portion of thefirst and second embodiments may be applied.

In the present embodiment, descriptions have been made on the examplewhere the smart device 10 is grasped by the right hand. However, thepresent embodiment is not limited to the example and may be applied tothe case where the smart device 10 is grasped by the left hand. FIG. 25illustrates an example of the arrow 94 indicating the pre-registereddirection for the movement of the screen image 53-0 when the smartdevice 10 is grasped by the left hand. FIG. 26 illustrates an example ofthe movement of the screen image 53-0.

According to the present embodiment, the determination unit 11determines whether an action is performed with an intention to contactan object displayed at a position that may not be contacted by the thumbapproaching the display unit 14 displaying a screen image thereon. Whenit is determined by the determination unit 11 that the action with theintention to contact the object is performed, the display controller 12performs a control to move the screen image in the direction in whichthe object approaches the thumb.

According to the present embodiment, the determination unit 11determines whether an action of grasping the smart device 10 whileapplying thereto a pressure having a value exceeding a predeterminedvalue is performed, as the action with the intention to contact theobject. When it is determined that the action of grasping the smartdevice 10 while applying thereto a pressure having a value exceeding thepredetermined value is performed, the display controller 12 performs acontrol to move the screen image in the direction in which the objectapproaches the thumb.

For example, when a user grasps a smart device 10 with one hand, and theuser intends to touch an object (e.g., an application icon) present at aposition that the thumb does not reach, the user stretches the thumbtoward the application icon. At this time, a stronger pressure isapplied to the smart device 10 by the user's fingers grasping the smartdevice 10, than that when the thumb is not stretched. The movementamount M of the screen image 53-0 is determined depending on a value ofthe pressure. According to the present embodiment, since the directionof the thumb is not determined, the configuration to detect the thumbhovering over the touch panel display 34 may be omitted.

According to the present embodiment, the display change to a screenimage which facilitates the one-hand operation of the informationprocessing device may be implemented by the user's natural action ofstrongly grasping the information processing device.

All examples and conditional language recited herein are intended forpedagogical purposes to aid the reader in understanding the disclosureand the concepts contributed by the inventor to furthering the art, andare to be construed as being without limitation to such specificallyrecited examples and conditions, nor does the organization of suchexamples in the specification relate to a showing of the superiority andinferiority of the disclosure. Although the embodiments of the presentdisclosure have been described in detail, it should be understood thatthe various changes, substitutions, and alterations could be made heretowithout departing from the spirit and scope of the disclosure.

What is claimed is:
 1. An information processing device, comprising: amemory; and a processor coupled to the memory and the processorconfigured to determine whether a first action is performed, the firstaction being defined as indicating an intention to contact an objectdisplayed at a position that may not be contacted by a thumb approachinga display unit on which a screen image is displayed, and move, when itis determined that the first action is performed, the screen image in adirection in which the object approaches the thumb.
 2. The informationprocessing device according to claim 1, wherein the first action is anaction of stretching the thumb approaching the display unit.
 3. Theinformation processing device according to claim 2, wherein theprocessor is configured to determine whether the stretched thumb is bentafter the movement, and move the screen image back to an originalposition when it is determined that the stretched thumb is bent, theoriginal position being a position of the screen image before themovement.
 4. The information processing device according to claim 1,wherein the processor is configured to detect an operation amount of anoperation performed on the information processing device, and determine,depending on the detected operation amount, a movement amount of movingthe screen image in the movement.
 5. The information processing deviceaccording to claim 4, wherein the operation amount is a value of apressure applied to the information processing device when an action ofgrasping the information processing device is performed.
 6. Theinformation processing device according to claim 1, wherein the firstaction is an action of grasping the information processing device whileapplying thereto a pressure having a value exceeding a predeterminedvalue.
 7. A display control method, comprising: determining, by acomputer, whether a first action is performed, the first action beingdefined as indicating an intention to contact an object displayed at aposition that may not be contacted by a thumb approaching a display uniton which a screen image is displayed; and moving, when it is determinedthat the first action is performed, the screen image in a direction inwhich the object approaches the thumb.
 8. The display control methodaccording to claim 7, wherein the first action is an action ofstretching the thumb approaching the display unit.
 9. The displaycontrol method according to claim 8, comprising: determining whether thestretched thumb is bent after the movement; and moving the screen imageback to an original position when it is determined that the stretchedthumb is bent, the original position being a position of the screenimage before the movement.
 10. The display control method according toclaim 7, comprising: detecting an operation amount of an operationperformed on the computer; and determining, depending on the detectedoperation amount, a movement amount of moving the screen image in themovement.
 11. The display control method according to claim 10, whereinthe operation amount is a value of a pressure applied to the computerwhen an action of grasping the computer is performed.
 12. The displaycontrol method according to claim 7, wherein the first action is anaction of grasping the computer while applying thereto a pressure havinga value exceeding a predetermined value.
 13. A non-transitorycomputer-readable recording medium having stored therein a program thatcauses a computer to execute a process, the process comprising:determining whether a first action is performed, the first action beingdefined as indicating an intention to contact an object displayed at aposition that may not be contacted by a thumb approaching a display uniton which a screen image is displayed; and moving, when it is determinedthat the first action is performed, the screen image in a direction inwhich the object approaches the thumb.
 14. The non-transitorycomputer-readable recording medium according to claim 13, wherein thefirst action is an action of stretching the thumb approaching thedisplay unit.
 15. The non-transitory computer-readable recording mediumaccording to claim 14, the process comprising: determining whether thestretched thumb is bent after the movement; and moving the screen imageback to an original position when it is determined that the stretchedthumb is bent, the original position being a position of the screenimage before the movement.
 16. The non-transitory computer-readablerecording medium according to claim 13, the process comprising:detecting an operation amount of an operation performed on the computer;and determining, depending on the detected operation amount, a movementamount of moving the screen image in the movement.
 17. Thenon-transitory computer-readable recording medium according to claim 16,wherein the operation amount is a value of a pressure applied to thecomputer when an action of grasping the computer is performed.
 18. Thenon-transitory computer-readable recording medium according to claim 13,wherein the first action is an action of grasping the computer whileapplying thereto a pressure having a value exceeding a predeterminedvalue.